IEEE Transactions on Neural Systems and Rehabilitation Engineering

This paper, for the first time, compares the behaviors of nonlinear versus linear muscle networks in decoding hidden peripheral synergistic neural patterns during dynamic functional tasks. In this paper, we report a case study during which one healthy subject conducts a series of four lower limb repetitive tasks. Specifically, the paper focuses on tasks that involve the right knee joint, including walking, sit-tostand, stepping, and drop-jump. Twelve muscles were recorded using the Delsys Trigno system. The linear muscle network was generated using coherence analysis, and the nonlinear network was generated using Spearmans correlation. The results show that the degree, clustering coefficient, and global efficiency of the muscle network have the highest value among tasks in the linear domain for the walking task, while a low linear synergistic network behavior for the sit-to-stand is observed. On the other hand, the results show that the nonlinear functional muscle network decodes high connectivity (degree) and clustering coefficient and efficiency for the sit-tostand when compared with other tasks. We have also developed a two-dimensional functional connectivity plane composed of linear and nonlinear features and shown that it can span the lower-limb dynamic task space. The results of this paper for the first time highlight the importance of observing both linear and nonlinear connectivity patterns, especially for complex dynamic tasks. It should also be noted that through a simultaneous EEG recording (using BrainVision System), we have shown that, indeed, cortical activity may indirectly explain highly-connected nonlinear muscle network for the sit-to-stand task, highlighting the importance of nonlinear muscle network as a neurophysiological window of observation beyond the periphery.

Brain-computer interface (BCI) can assist paralyzed patients in controlling external devices and improve their quality of life. However, existing intracortical BCIs entail risks of infection and challenges of long-term stability. In this study, we report on a tetraplegic patient implanted with our newly developed wireless minimally invasive BCI, NEO, in which eight Pt-Ir electrodes were placed epidurally over the hand area of the right sensorimotor cortex to record field potentials. We found that epidural neural signals from the hand area simultaneously represented both contralateral and ipsilateral movements. The spatio-spectral patterns of different movements exhibited prominent distinctions, revealing a bilateral representation structure of limb movements. Moreover, when two limb effectors (e.g., hand and elbow) moved simultaneously, their neural patterns exhibited non-additive changes relative to single movements. Based on these findings, we proposed a fine grained bilateral single/dual-movement decoding scheme for two-dimensional target control, thereby extending the degrees of freedom (DoF) of minimally invasive BCI systems and enhancing the information transfer rate (ITR). In two-dimensional center-out and web-grid tasks, the system achieved mean Fitts ITRs of 36.7 bpm and 30.0 bpm, respectively, with hit rates exceeding 91%. Neural recordings remained stable for over 18 months, and the decoder maintained stable performance for over 6 months without recalibration, demonstrating the safety and reliability of long-term home use.

As an emerging neurostimulation for improving motor rehabilitation, applying vagus nerve stimulation (VNS) after successful movement during training facilitates motor recovery in animals with neuromotor impairment. To translate this procedure to human rehabilitation in a non-invasive, objective, and automated manner, real-time classification of movement quality on a trial-by-trial basis in a minimally constrained state is required. In this work, we developed an integrated closed-loop system using video-based real-time movement classification that can automatically trigger transcutaneous VNS (tVNS) wirelessly as soon as successful movement is detected. We also created a film-like conformable tVNS electrode to be attached over the outer ear. For movement training, we focused on the use case of dance therapy (backward walking), which is widely used for people with Parkinsons disease and older adults. Our markerless video analysis model could detect steps with 0.91 precision and 0.72 recall and classify successful backward steps with a 0.93 F1 score. The classification triggers tVNS through Bluetooth Low Energy communications with a trigger relay device we created. The integrated system enabled real-time automated classification and stimulation, triggering tVNS with 71.3% of the successful movements and taking 2.24 s from video capture to tVNS. We consider our work to be an important step toward patient-driven rehabilitation at home showcasing non-invasive, low-cost, and automated closed-loop neurostimulation technologies.

Recent advancements in data-driven methods have enabled real-time estimation of biomechanical states for exoskeleton control. While biological joint moments can be directly used to scale exoskeleton assistance, this approach is often suboptimal. An optimized mapping between biological joint moments and exoskeleton assistance could enhance end-to-end controllers based on the users physiological state. We introduce a flexible parametrization of biological moment-based control using delay, scaling, and shaping terms to transform joint moment estimates into commanded torque. We performed human-in-the-loop optimization, using metabolic cost to evaluate each iterations controller parameters, for 9 subjects across three ambulation modes: level walking at 1.1 m/s, 1.5 m/s, and 5{degrees} inclined walking. We evaluated three methods of exoskeleton control: 1. Personalized/Task Dependent, 2. Task Dependent/Non-personalized, and 3. Task Agnostic/Non-personalized. On average, our personalized approach provided the greatest benefit of 18.3% reduction in metabolic cost compared to walking without the exoskeleton, with the task dependent and task agnostic controllers producing similar reductions of 8.6% and 8.4%, respectively. Our results show that while generalizable, task agnostic control parameters can improve user energetics across cyclic tasks, fully personalized exoskeleton control parameters yield larger metabolic reductions, highlighting the value of personalizing exoskeleton assistance to users across many diverse tasks.

Robotic-Assisted Gait training (RAGT) offers an innovative therapeutic option for restoration of functional gait in stroke survivors, complementing existing physical rehabilitation strategies. However, there is a limited understanding of the neurophysiological response induced by this training in end-users. Neural desynchronization and Cortico-Muscular Coherence (CMC) are two biomarkers that define the level of muscle-cortex association during gait phases and can be used to estimate induced users adaptation during RAGT. In this study, we measure Event-Related Spectral Perturbation (ERSP) and CMC from three healthy individuals and three stroke survivors during overground-gait with and without an exoskeleton. Results show that (1) the use of the exoskeleton in healthy individuals is associated with a different and more refined motor-control represented in a high{theta} -desynchronization, (2) altered and noisy ERSP and lower and non-focal {beta}-CMC patterns are observed in Stroke patients when performing overground-gait both with and without the Exoskeleton, and (3) Exoskeleton use in stroke survivors is associated with a reduction in swing-time during gait-cycle, but this effect is not correlated with an increment of{theta} -desynchronization and/or {beta}-CMC. ERSP and CMC demonstrated evidence of neural modulation in able-bodied users during RAGT, which could not be detected in subacute stroke survivors during RAGT. These results suggest that the gait-parameters changes observed during exoskeleton use in subacute stroke survivors are unlikely to be neurally driven.

Neural activities within the beta frequency range (13-30 Hz) are not stationary, but occur in transient packets known as beta bursts. Parkinsons disease (PD) is characterized by the occurrence of beta bursts of increased duration and amplitude within the cortico-basal ganglia network. The pathophysiological importance of beta bursts is exemplified by the fact that they serve as a clinically useful feedback signal in beta amplitude triggered adaptive Deep Brain Stimulation (aDBS). Prolonged duration beta bursts are closely associated with motor impairments in PD, whilst bursts of shorter duration may have a physiological role. Consequently, we aimed to develop a deep learning-based pipeline capable of predicting long (> 150ms) and short (< 150ms) duration beta bursts from subthalamic nucleus local field potential (LFP) recordings. Our approach achieved promising accuracy values of 87% and 85.2% in two patients implanted with a DBS device that was capable of long-term wireless LFP sensing. Our findings highlight the feasibility of prolonged beta burst prediction and could inform the development of a new type of intelligent DBS approach with the capability of delivering stimulation only during the occurrence of prolonged bursts.

The velocity vector field (flow) controller is a well-established control strategy for lower limb exoskeletons. In this paper, we analyze this controller and propose modifications to improve its performance. We demonstrate that flow control acts as a variable proportional-derivative error regulator, where the parameter {Gamma} represents the desired norm of the hip-knee joint velocity vector (path speed). Based on this, we introduce two modifications to {Gamma}: (1) a constant {Gamma} set to the mean desired path speed, and (2) a variable {Gamma} that mimics natural path speed during unassisted walking. We compared the modified flow controllers with a slow-{Gamma} version in experiments involving seven participants walking on a treadmill at 0.6m/s, 0.8m/s, and 1.0m/s. Compared to the slow-{Gamma} controller, the RMS tracking error decreased by 30.7{+/-} 11.3% and the range of motion of the knee increased by 48.2 {+/-} 5.5% for the mean-{Gamma} controller, while the variable-{Gamma} controller had 32.4 {+/-} 14.7% smaller RMS error and 50.5 {+/-} 6.5% larger range of motion of the knee. Additionally, the slow-{Gamma} controller consistently applied resistive power, whereas participants reported more comfortable and natural gait with the modified controllers. We also compared them with the original tuning of flow controller, with results indicating superior performance from the proposed modifications. These findings demonstrate effectiveness across different walking speeds and offer a tuning strategy for future flow controller use.

Falls are a leading cause of injury and growing healthcare care costs, particularly in aging populations, yet subtle balance impairments often go undetected until severe problems arise. Accurately quantifying human balance has remained a critical challenge. Here, we introduce perturbation recovery time, a novel balance metric inspired by nonlinear dynamic system theory that quantifies the duration required for post-perturbation deviations to return to steady-state gait consistently. Unlike traditional assessments that rely on regular walking patterns, we used external perturbations to uncover hidden balance mechanisms that may not appear during steady-state walking. We identified key kinematic balance features, including the anterior-posterior distance between the center of mass and the center of pressure, whole-body angular momentum in the frontal and sagittal planes, and vertical center of mass position and acceleration, which encode significant balance information and enhance the sensitivity of the metric. These features reinforce the importance of foot placement, inverted pendulum dynamics, push-off control, and trunk motion to maintain human balance. The perturbation recovery time metric effectively identified subtle balance changes caused by controlled artificial impairments of sensing, actuation, and consistency. These findings demonstrate that the recovery process following external walking perturbations encodes critical information for quantifying human balance, offering a promising approach for early detection of balance impairments.

Robotic exoskeletons require human control and decision making to switch between different locomotion modes, which can be inconvenient and cognitively demanding. To support the development of automated locomotion mode recognition systems (i.e., high-level controllers), we designed an environment recognition system using computer vision and deep learning. We collected over 5.6 million images of indoor and outdoor real-world walking environments using a wearable camera system, of which ~923,000 images were annotated using a 12-class hierarchical labelling architecture (called the ExoNet database). We then trained and tested the EfficientNetB0 convolutional neural network, designed for efficiency using neural architecture search, to predict the different walking environments. Our environment recognition system achieved ~73% image classification accuracy. While these preliminary results benchmark Efficient-NetB0 on the ExoNet database, further research is needed to compare different image classification algorithms to develop an accurate and real-time environment-adaptive locomotion mode recognition system for robotic exoskeleton control.

The movement-related cortical potential (MRCP) is a low-frequency component of the electroencephalography (EEG) signal recorded from the motor cortex and its neighboring cortical areas. Since the MRCP encodes motor intention and execution, it may be utilized as an interface between patients and neurorehabilitation technologies. This study investigates the EEG signal recorded from the Cz electrode to discriminate between four levels of rate of force development (RFD) of the tibialis anterior muscle. For classification, three feature sets were evaluated to describe the EEG traces. These were (i) MRCP morphological characteristics in the{delta} -band such as amplitude and timing, (ii) MRCP statistical characteristics in the{delta} -band such as mean, standard deviation, and kurtosis, and (iii) wideband time-frequency features in the 0.5-90 Hz range. Using a support vector machine for classification, the four levels of RFD were classified with a mean (SD) accuracy of 82% (7%) accuracy when using the time-frequency feature space, and with an accuracy of 75% (12%) when using the MRCP statistical characteristics. It was also observed that some of the key features from the statistical and morphological sets responded monotonically to the intensity of the RFD. Examples are slope and standard deviation in the (0, 1)s window for the statistical, and min1 and minn for the morphological sets. This monotonical response of features explains the observed performance of the{delta} -band MRCP and corresponding high discriminative power. Results from temporal analysis considering the pre-movement phase ((-3, 0)s) and three windows of the post-movement phase ((0, 1)s, (1, 2)s, and (2, 3)s)) suggest that the complete MRCP waveform represents high information content regarding the planning, execution, duration, and ending of the isometric dorsiflexion task using the tibialis anterior muscle. Results shed light on the role of{delta} -band in translating to motor command, with potential applications in neural engineering systems.

After stroke, paretic arm muscles are constantly exposed to abnormal neural drive from the injured brain. As such, hypertonia, broadly defined as an increase in muscle tone, is prevalent especially in distal muscles, which impairs daily function or in long-term leads to a flexed resting posture in the wrist and fingers. However, there currently is no quantitative measure that can reliably track how hypertonia is expressed on daily basis. In this study, we propose a novel time-based surface electromyography (sEMG) measure that can overcome the limitations of the coarse clinical scales often measured in functionally irrelevant context and the magnitude-based sEMG measures that suffer from signal non-stationarity. We postulated that the key to robust quantification of hypertonia is to capture the "true" baseline in sEMG for each measurement session, by which we can define the relative duration of activity over a short time segment continuously tracked in a sliding window fashion. We validate that the proposed measure of sEMG active duration is robust across parameter choices (e.g., sampling rate, window length, threshold criteria), robust against typical noise sources present in paretic muscles (e.g., low signal-to-noise ratio, sporadic motor unit action potentials), and reliable across measurements (e.g., sensors, trials, and days), while providing a continuum of scale over the full magnitude range for each session. Furthermore, sEMG active duration could well characterize the clinically observed differences in hypertonia expressed across different muscles and impairment levels. The proposed measure can be used for continuous and quantitative monitoring of hypertonia during activities of daily living while at home, which will allow for the study of the practical effect of pharmacological and/or physical interventions that try to combat its presence.

There are many alternative methods to joystick control for control of Electric Powered Wheelchairs for users with neuromuscular disabilities, such as muscular dystrophy, and spinal cord injuries, such as tetraplegia. However, these methods- which include the sip-and-puff method, head and neck movement, blinking, or tongue movement- hinder social interaction, and are therefore detrimental to user independence. In recent years, research has explored the use of Electromyography (EMG) signals from alternative muscles to control a powered wheelchair, consequently increasing the quality of life of these users. The Auricular Muscles (AM) may be suitable, as they are controlled separately from the facial nerve and are vestigial in humans, making them advantageous for powered wheelchair control for users with tetraplegia. Additionally, they are located around the ear, adding a level of cosmesis when designing wearable sensors and prosthesis. This paper extracts and implements two control strategies from current literature and, for the first time, compares them directly, demonstrating viable implementation approaches for an online EMG-based powered-wheelchair control system. A Support Vector Machine (SVM) was developed and various window lengths were compared, with the most accuracy and real-time effectiveness found at 300ms. A study with three participants demonstrates the feasibility of these methods of control as well as experimental results to guide the potential AM use.

Real-time brain-computer interfaces (BCIs) that decode electroencephalograms (EEG) during motor imagery (MI) are a powerful adjunct to rehabilitation therapy after neurotrauma. Immersive virtual reality (VR) could complement BCIs by delivering multisensory feedback congruent to the users MI, enabling therapies that engage users in task-oriented scenarios. Yet, therapeutic outcomes rely on the users proficiency in evoking MI to attain volitional BCI-commanded VR interaction. While previous studies suggested that users could improve BCI-evoked MI within a single session, the effects of multiple training sessions on sensorimotor neuromodulation remain unknown. Here, we present a longitudinal study assessing the impact of VR-mediated BCI training on lower-limb sensorimotor neuromodulation, wherein an EEG-based BCI was coupled with congruent real-time multisensory feedback in immersive VR. We show that unimpaired individuals could learn to modulate their sensorimotor activations during MI virtual walking over multiple training sessions, also resulting in increased BCI control accuracy. Additionally, when extending the system to immersive VR cycling, four individuals with chronic complete spinal cord injury (SCI) showed similar improvements. This is the first study demonstrating that individuals could learn modulating sensorimotor activity associated with MI using BCI integrated with immersive VR over multiple training sessions, even after SCI-induced motor and sensory decline. These results suggest that VR-BCI training may facilitate neuroplasticity, potentially strengthening sensorimotor pathways and functional connectivity relevant to motor control and recovery.

BackgroundThe gait pattern results from a complex interaction of several body parts, orchestrated by the (central) nervous system that controls the active and passive systems of the body. An impairment of gait due to a stroke results in a decline in quality of life and independence. Setting up efficient gait training requires an objective and wholesome assessment of the patients movement pattern to target individual gait alterations. However, current assessment tools are limited in their ability to capture the complexity of the movement and the amount of data acquired during gait analysis. AimsIn this study, we explore the potential of variational autoencoders (VAE) to learn and recognise different gait patterns within both, pathologic and healthy gait. MethodsFor this purpose, the lower-limb joint angles of 71 participants (29 stroke survivors, 42 healthy controls) were used to train and test a VAE. ResultsThe good reconstruction results (range r = 0.52 - 0.91, average normalized RMSE 23.36 % {+/-} 4.13) indicate that VAEs extract meaningful information from the gait pattern. Furthermore, the extracted latent features are sensitive enough to distinguish between the gait patterns of stroke survivors and a healthy cohort (p<0.001). ConclusionsThe presented approach allows the assessment of gait data in an objective and wholesome manner, thereby integrating the individual characteristics of each persons gait, making it a suitable tool for monitoring the progress of rehabilitation efforts.

Despite the common focus of gait in rehabilitation, there are few tools that allow quantitatively characterizing gait in the clinic. We recently described an algorithm, trained on a large dataset from our clinical gait analysis laboratory, which produces accurate cycle-by-cycle estimates of spatiotemporal gait parameters including step timing and walking velocity. Here, we demonstrate this system generalizes well to clinical care with a validation study on prosthetic users seen in therapy and outpatient clinic. Specifically, estimated walking velocity was similar to annotated 10-meter walking velocities, and cadence and foot contact times closely mirrored our wearable sensor measurements. Additionally, we found that a 2D keypoint detector pre-trained on largely able-bodied individuals struggles to localize prosthetic joints, particularly for those individuals with more proximal or bilateral amputations, but it is possible to train a prosthetic-specific joint detector. Further work is required to validate the other outputs from our algorithm including sagittal plane joint angles and step length. Code and trained weights will be released upon publication.

For exoskeletons to be successful in real-world settings, they will need to be effective across a variety of terrains, including on inclines. While some single-joint exoskeletons have assisted incline walking, recent successes in level-ground assistance suggest that greater improvements may be possible by optimizing assistance of the whole leg. To understand how exoskeleton assistance should change with incline, we used human-in-the-loop optimization to find whole-leg exoskeleton assistance torques that minimized metabolic cost on a range of grades. We optimized assistance for three expert, able-bodied participants on 5 degree, 10 degree and 15 degree inclines using a hip-knee-ankle exoskeleton emulator. For all assisted conditions, the cost of transport was reduced by at least 50% relative to walking in the device with no assistance, a large improvement to walking that is comparable to the benefits of whole-leg assistance on level-ground. This corresponds to large absolute reductions in metabolic cost, with the most strenuous conditions reduced by 4.9 W/kg, more than twice the entire energy cost of level walking. Optimized extension torque magnitudes and exoskeleton power increased with incline, with hip extension, knee extension and ankle plantarflexion often growing as large as allowed by comfort-based limits. Applied powers on steep inclines were double the powers applied during level-ground walking, indicating that larger exoskeleton power may be optimal in scenarios where biological powers and costs are higher. Future exoskeleton devices can be expected to deliver large improvements in walking performance across a range of inclines, if they have sufficient torque and power capabilities.

A detailed comprehension of the central and peripheral processes underlying walking is essential to develop effective therapeutic interventions to slow down gait decline with age, and rehabilitation strategies to maximize motor recovery for patients with damages at the central nervous system. The combined use of electromyography (EMG) and electroencephalography (EEG), in the framework of coherence analysis, has recently established for neuromotor integrity/impairment assessment. In this study, we propose corticomuscular (EEG-EMG) and inter/intramuscular (EMG-EMG) coherences as measures of the cognitive reserve, i.e., the process whereby a wider repertoire of cognitive strategies, as well as more flexible and efficient strategies, can moderate the manifestation of brain disease/damage. We recorded EEG signals from the main brain source locations and superficial EMG signals from the main leg muscles involved in gait in 16 healthy young adults (age [&le;]30 years) and 13 healthy elderly (age [&ge;]65 years) during three different overground walking conditions (i.e., spontaneous walking, walking with cognitive dual-task, and walking with targets drawn on the floor). In all conditions, we calculated corticomuscular and inter/intramuscular coherences. We observed higher corticomuscular and inter/intramuscular coherences during targeted walking compared to spontaneous walking in both groups, even if the increase was greater in young people. Considering dual-task walking compared to spontaneous walking, only corticomuscular coherence in the elderly increased. These results suggest age-related differences in cognitive reserve that reflect different abilities to perform complex cognitive or motor tasks during gait. This study demonstrates the feasibility, repeatability, and effectiveness of the proposed method to investigate brain-to-muscle connectivity during different gait conditions, to study the related changes with age, and to quantify the cognitive reserve.

For a seamless integration of electroencephalography (EEG)-based motor imagery brain-computer interfaces (MI-BCIs), it is vital to be able to classify movements of the same joint. However, a fundamental challenge in classifying the same joint movements arises from the close spatial proximity of the corresponding brain regions. To address this challenge, we explore the feasibility of distinguishing up and down movements specific to the right upper limb using multiple frequency bands combined with a channel averaging method. Six electrodes positioned in close proximity to the motor cortex and two distinct frequency bands: mu (8-12Hz) and beta (12-30Hz) were selected. This isolates and enhances electromagnetic activity in the brain commonly associated with motor and cognitive processing. The results of our study revealed promising outcomes across two classification methods. Utilizing a support vector machine (SVM) classifier, our proposed approach achieved an average accuracy of 59.3% and a k-nearest neighbor(KNN) classifier approach yielded an average accuracy of 61.63% in distinguishing between upward and downward movements of the right arm. These results demonstrate the potential of combining spatially focused EEG acquisition with frequency-specific analysis for improved MI-BCI performance.

BackgroundAccurate gait recognition from daily physical activities is a critical first step for further fall risk assessment and rehabilitation monitoring based on inertial sensors. However, most openly available models are based on healthy young adults ambulating in structured conditions. ObjectiveThis study aimed to develop an open-source and externally validated algorithm for daily-life gait recognition of older adults based on acceleration and angular velocity, as well as acceleration data only, and explore the effect of the use of data augmentation in the model training. MethodsA convolutional neural network was trained for gait recognition. The data for model training was lower-back inertial sensor data from 20 older adults (mean age 76 years old), with annotated synchronized activity labels in semi-structured and daily-life conditions. The data was randomly split into training, validation, and testing datasets by participants, and the model was trained multiple times using these different splits. The model was trained based on data from six channels (accelerations and angular velocities) and three channels (accelerations only) under conditions with and without data augmentation, respectively. External validation was evaluated based on lower-back sensor data collected from 47 stroke survivors (mean age 72.3 years old) in balance and walking tests. ResultsFor the testing dataset, the median accuracy ranged from 94 % to 98 %, precision from 63 % to 85 %, sensitivity from 95 % to 97 %, F1-score from 76 % to 90 %, and specificity from 94 % to 98 %. For the external validation dataset, the median accuracy ranged from 97 % to 100 %, precision from 99.9 % to 100 %, sensitivity from 71 % to 100 %, F1-score from 83 % to 100 %, and specificity 100 %. ConclusionsBased on lower-back-worn inertial sensor data, we provide an accurate, open-source, and externally validated daily-life gait recognition algorithm for older adults, with one model for six-axis input data and another for three-axis input data. Besides, we found when training the model, the use of data augmentation is especially helpful on the model based on acceleration data only.

Accurate neural decoding of brain dynamics remains a significant and open challenge in brain-machine interfaces. While various signal processing, feature extraction, and classification algorithms have been proposed, a systematic comparison of these is lacking. Accordingly, here we conducted one of the largest comparative studies evaluating different combinations of state-of-the-art algorithms for motor neural decoding to find the optimal combination. We studied three signal processing methods (i.e., artifact subspace reconstruction, surface Laplacian filtering, and data normalization), four feature extractors (i.e., common spatial patterns, independent component analysis, short-time Fourier transform, and no feature extraction), and four machine learning classifiers (i.e., support vector machine, linear discriminant analysis, convolutional neural networks, and long short-term memory networks). Using a large-scale EEG dataset, we optimized each combination for individual subjects (i.e., resulting in 672 total experiments) and evaluated performance based on classification accuracy. We also compared the computational and memory storage requirements, which are important for real-time embedded computing. Our comparative analysis provides novel insights that help inform the design of next-generation neural decoding algorithms for brain-machine interfaces used to interact with and control robots and computers.